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PREFACE 

The  Project  RAND  research  program  consists  in  part 
of  basic  supporting  studies  in  mathematics.  This 
Memorandum  analyses  a  new  method  for  the  solution  of 
equations  of  the  form 

u  =  f  +  X-T(u)  , 

where  T  is  a  linear  transformation.  Such  equations  are 
of  great  importance  in  mathematical  physics. 
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SUMMARY 


A  large  number  of  problems  of  mathematical  physics: 
may  be  reduced  to  the  solution  of  the  equation 

u  =  f  +  Xt(u)  , 

where  T  is  a  linear  transformation.  The  present  paper 
reduces  a  recent  proposal  to  treat  such  problems  by  means 
of  continued  fractions  to  a  more  tractable  method  involving 
series,  and  demonstrates  the  convergence  of  the  resulting 
series  over  a  larger  domain  than  the  classical  Neumann 


series . 
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ANALYSIS  OP  A  NEW  FORMALISM  IN  PERTURBATION  THEORY 

1 .  INTRODUCTION 

A  new  method  has  recently  been  suggested  by  Bellman 
and  Richardson  [l]  for  studying  equations  of  the  form 

(1.1)  u  =  f  +  Xt(u)  , 

where  f  is  a  known  function,  u  is  unknown,  X  is  a 
parameter,  and  T  is  a  linear  transformation .  This 
suggestion  is  based  on  the  observation  that,  if  u  is  a 
solution  to  (1.1),  then 

!  _  tWi^+V) 

,  Tn+1(»)/^(u)  . 

Thus,  if  the  value  of  Tn(u)/Tn+^(u)  can  be  determined, 
the  value  of  u/T(u)  can  be  determined  recursively,  and  by 
combining  this  with  (1.1),  the  value  of  u  itself  may  be 

computed.  If  we  make  the  assumption  that  Tn(u)/Tn+^(u) 
equals  Tn(f )/Tn+^( f ) ,  then  carrying  out  the  above 
computation  gives  a  sequence  of  convergents  to  a  certain 
continued  fraction.  One  could  analyze  the  method  by 
considering  this  continued  fraction,  but  in  what  follows  we 
shall  show  that  it  is  quite  easy  to  evaluate  and  analyze 
the  convergents  themselves. 

2_. _ PRECISE  DEFINITION  OF  THE  CONVERGENTS 

Characterize  the  function  u  as  follows: 


(1.2) 


.  = 

fn+1(u) 


Tn+l(f ) 


+  X 
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(2.6) 


T1C(u|e) 

Tk+1(ulc) 

I^(uk) 


Air 

1  Tk~^(f )/Tk(f ) 

Tk(uk)/Tk+1(uk) 


£Lh*i  +  \ 

Tk(f) 


is  equivalent  to  replacing  T^(f)  (in  the  formula  of  form 
(2.4)  for  uk_1)  with 

(2.7)  _ (Tk(f)]g  T^Rf) _ 

Tk-1(f)  ■Tk+1(f)  +  X  [(iRf))2  -  Tlt_1(f)  Tk+1(f)) 

If  we  carry  out  this  substitution,  we  find  that  uk 
also  satisfies  the  formula  (2.4),  and  thus  the  formula 
holds  for  all  n. 

3.  PROPERTIES  OF  THE  un 

Theorem  J.l  If  T^f)  =  MTn(f)  for  some  fi  4  1/X  , 
then  un  is  a  solution  to  (l.l). 

Proof:  Substitute  (2.4)  directly  into  (1.1). 

Theorem  3 -2  Within  the  radius  of  convergence  of  the 
Neumann  series,  the  sequence  (un)  converges  to  a  solution 
of  (1.1) . 

Proof:  The  radius  of  convergence  of  the  Neumann 
, series  is  the  absolute  value  of  the  eigenvalue  of  T 
having  the  smallest  norm.  Thus  if  ^  is  less  than  this 
eigenvalue  we  may,  by  talcing  n  sufficiently  large,  make 
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■f" 

the  difference  between  un  and  the  nL  partial  sum  of  the 
Neumann  series  as  small  as  we  please..  Thus,  the  sequence 
(un)  converges  to  the  same  limit  as  the  Neumann  series, 
which  is  a  solution  of  (1.1). 

Theorem  3 .3  If  f  =  f^  +  f2  ,  where  T  is  continuous 

T(f1)  -  M]_f1  and  |Tk(f2)|  <  U2  |Tk-1(f2)|  (for  k=l,  2.  ...) 

M 1  >  M2  >  0,  ^41/^2  ,  M  <1/|m-2I  .  then  (un)  is  a  Cauchy 

sequence  convergent  to  a  solution  of  (1.1). 

Proof :  If  k  is  sufficiently  large,  it  is  a  matter 
of  straightforward  computation  to  show  that 


(3-1) 


[  Tk  ( f )  f 

Tk(f)  -  XT*+1(f) 


u  2k  f  2 

Mi 


h  f- 


XM1k+1f 


| |f2 | |  (Mi~m2)  k 


Say  that  (3-1)  holds  for  all  k  >  N.  Pick  m  >  n  >  N- 
Now  consider 


(3-2) 


u_  —  u  m— n— 1 


m 


_n  _ 


Ln  i=0 


'  /  m  .  TnJ-1 


Tm( f )  -  XTm+1(f) 


T^(f)  -  XTn+1(f) 


Simple  computation  shows  that 


(3-3) 


s  = 


«i,.  .  x>-n£Tm(r1)]‘ 


n>-n— 1 

1=0  1  T^(f1)  -  XTm+1(f1) 

[Tn(f1)]2 


-  XTn+1(f1) 


m— n— 1 

2  (MtM^  + 

i=0 


v1  ^  (mA) 


m-n 


1 


1 

l^ITX 


fl  -  0 


Thus  it  follows,  from  (3-1)  and  the  linearity  of 
T,  that 


(3-4) 


u 

— 

[ 

u  —  u 

-  s 

m 

n 

L  =  _ 

m  n 

Xn 

Xn 

m-n— 1 
<  Z 
i=0 


Mo* 


Me 


n 


m-n. 


Mr 


+  C 


Mr 


n 


n 


r  v 

1  -  Mr 

C 

Since 


XMr 


<  1  by  hypothesis,  this  establishes 


that  the  sequence  {.u  }  is  a  Cauchy  sequence.  Now  to  show 
that  it  converges  to  a  solution  of  (1.1),  we  have  only  to 
show  that  for  any  e  >  0,  we  can  find  an  N  such  that  if 
n  >  N,  then 


un  -  XT<un>  -  f 


<  6 
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Thls  Is  equivalent  to  showing  that 


(>•5) 


n+1 

Tn+1(f )Tn(f ) 

_  m 

Tn(f)Tn(f) 

A. 

Tn(f)  -  XTn+  '( f ) 

—  1 

Tn(f)  -  XTn+1(f) 

By  applying  the  identity 


(3-6) 


Tn|  f ) _ i _  XTn+I(f2)-X41Tn(fg) 

Tn(f)  -  XTn+1(f)  1  -  X/l^  (1-Xpi1)  (Tn(f)-XTn+1(f)) 


we  reduce  (3-5)  to 


(3-7) 


Ul 

n+1 

XTn+1(fg)  -  X/x1Tn(f2) 

XTn+1(f2)-XM1Tn(f2)1 

1-XMX 

Tn(f)/Tn+1(f)  -  X 

.  1  -  XTn+1(f )/Tn(f )J 

n 


Tn(fg) 


can  be  made 


But  since  by  assumption 
as  small  as  we  please  by  taking  n  sufficiently  great, 
it  follows  at  once  that  (3-1)  goes  to  zero  as  n  becomes 
large.  This  concludes  the  proof. 


4 .  EXAMPLES 

A.  If  T(f)  =  kf,  where  k  is  some  constant,  then 
by  Theorem  3-1,  every  un  is  an  exact  solution  to  (1.1) 
(provided  X  4  l/k)  . 

(2  -1 

B-  Let  the  transformation  T  be  the  matrix j 

V - 1  2 

which  has  eigenvalues  1  and  3.  Then  the  sequence  {un)  will 


converge  by  Theorem  3.3  to  a  solution  of  (1.1 )  if  |X|  <  1 

X  4  1/3 .  If  f  is  an  eigenvector  of  T,  then  each  un 

will  be  an  exact  solution  of  (l.l)  unless  X  is  the 

reciprocal  of  the  corresponding  eigenvalue.  This  example 

shows  that  {uR)  need  not  converge  if  X  is  greater  than 

* 

the  reciprocal  of  the  second  largest  eigenvalue. 

C.  The  formula  may  be  applied  to  a  wide  variety  of 
integral  equations.  Even  when  the  Neumann  series  converges 
the  sequence  (2.4)  will  often  converge  faster. 


* 

The  reader  is  doubtless  aware  that  the  eigenvalue  of 
a  matrix  corresponds  to  the  reciprocal  of  the  eigenvalue 
of  an  integral  operator  (which  is  the  sense  in  which  we 
used  the  term  in  the  proof  of  Theorem  3-2.) 
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